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Abstract.  ROBART  III  is  intended  as  an  advanced  demonstration  platform  for  non-lethal  tactical  response, 
extending  the  concepts  of  reflexive  teleoperation  into  the  realm  of  coordinated  weapons  control  (i.e.,  sensor-aided 
control  of  mobility,  camera,  and  weapon  functions)  in  law  enforcement  and  urban  warfare  scenarios.  A  rich  mix 
of  ultrasonic  and  optical  proximity  and  range  sensors  facilitates  remote  operation  in  unstructured  and  unexplored 
buildings  with  minimal  operator  oversight.  Supervised  autonomous  navigation  and  mapping  of  interior  spaces  is 
significantly  enhanced  by  an  innovative  algorithm  which  exploits  the  fact  that  the  majority  of  man-made  structures 
are  characterized  by  (but  not  limited  to)  parallel  and  orthogonal  walls.  This  paper  presents  a  brief  overview  of  the 
advanced  telereflexive  man-machine  interface  and  its  associated  “human-centered  mapping”  strategy. 
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1.  Background 

Erom  a  navigational  perspective,  the  type  of  control 
strategy  employed  on  a  mobile  platform  runs  the 
full  spectrum  defined  by  teleoperated  at  the  low  end 
through  fully  autonomous  at  the  upper  extreme.  A  tele¬ 
operated  machine  of  the  lowest  order  has  no  onboard 
intelligence  and  blindly  executes  the  drive  and  steering 
commands  sent  down  in  real-time  by  a  remote  opera¬ 
tor.  A  fully  autonomous  mobile  platform,  on  the  other 
hand,  keeps  track  of  its  position  and  orientation  and 
typically  uses  some  type  of  world  modeling  scheme  to 
represent  the  location  of  perceived  objects  in  its  sur¬ 
roundings.  A  very  common  approach  is  to  employ  a 
statistical  certainty-grid  representation  (Moravec  and 
Elfes,  1985),  where  each  cell  in  the  grid  corresponds  to 
a  particular  “unit  square”  of  floor  space.  The  numerical 
value  assigned  to  each  cell  represents  the  probability 
that  its  associated  location  in  the  building  is  occupied 
by  some  object,  with  a  value  of  zero  indicating  free 
space  (i.e.,  no  obstacles  present). 

The  existence  of  an  absolute  world  model  allows 
for  automatic  path  planning,  and  subsequent  route 
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revisions  in  the  event  a  new  obstacle  is  encountered. 
Unfortunately,  however,  the  autonomous  execution 
of  indoor  paths  generally  requires  a  priori  knowl¬ 
edge  of  the  floorplan  of  the  operating  environment, 
and  in  all  cases  the  robot  must  maintain  an  accu¬ 
rate  awareness  of  its  position  and  orientation.  Accord¬ 
ingly,  traditional  autonomous  navigation  techniques 
(Borenstein  et  al.,  1 996)have  until  recently  been  of  lim¬ 
ited  utility  for  applications  where  a  requirement  exists 
to  enter  previously  unexplored  structures  of  opportu¬ 
nity  as  the  need  arises.  (More  recent  efforts  have  begun 
to  make  some  noteworthy  progress  in  this  arena,  as  re¬ 
ported  by  Gutmann  and  Konolidge  (2000)  and  Thrun 
et  al.  (2000),  for  example.) 

Teleoperated  systems,  on  the  other  hand,  permit 
remote  operation  in  such  unknown  environments,  but 
conventionally  place  unacceptable  demands  on  the  op¬ 
erator.  Simply  driving  a  teleoperated  platform  using 
vehicle-based  video  feedback  is  no  trivial  matter,  and 
can  be  stressful  and  fatiguing  even  under  very  favorable 
conditions  (AvilesetaL,  1990)  .If  a  remote  operator  has 
to  master  simultaneous  inputs  for  drive,  steering,  cam¬ 
era,  and  weapons  control,  the  chances  of  successfully 
performing  coordinated  actions  in  a  timely  fashion  are 
minimal. 
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Easing  the  driving  burden  on  the  operator  was  a 
major  force  behind  the  development  of  the  reflexive 
teleoperated  control  scheme  employed  on  ROBART  n 
(Everett  et  ah,  1990;  Laird  and  Everett,  1990),  a 
prototype  security  robot  capable  of  both  teleoper¬ 
ated  and  autonomous  operation.  The  robot’ s  numerous 
collision-avoidance  sensors,  originally  intended  to  pro¬ 
vide  an  envelope  of  protection  during  autonomous  tran¬ 
sit,  were  also  called  into  play  during  manual  operation 
to  greatly  minimize  the  possibility  of  operator  error. 
The  commanded  velocity  and  direction  of  the  platform 
was  altered  by  the  onboard  processors  to  keep  the  robot 
traveling  at  a  safe  speed  and  preclude  running  into  ob¬ 
structions.  Work  on  ROBART  III  (Eig.  1)  now  extends 
this  reflexive-teleoperation  concept  into  the  realm  of 
sensor-assisted  camera  and  weapon  control  for  indoor 
tactical  systems. 


Figure  1 .  ROBART  III  is  a  laboratory  prototype  supporting  the 
development  of  enhanced  telereflection  control  strategies  for  tactical 
response  robots. 


2.  Man-Machine  Interface 

A  very  simplistic  graphical  user  interface  (GUI)  has 
been  implemented  under  Visual  Basic  to  support  the 
development  and  diagnostic  needs  of  this  technology- 
base  effort  (Eig.  2).  Eor  purposes  of  this  discussion, 
the  man-machine  interface  issues  can  be  subdivided 
into  three  general  categories;  1)  mobility  control,  2) 
camera  control,  and  3)  non-lethal  weapon  control. 

2.7.  Mobility  Control 

The  Mobility  Control  Window  (lower  right  corner  of 
the  screen)  provides  a  convenient  means  for  the  opera¬ 
tor  to  set  the  desired  speed,  and  if  necessary,  manually 
change  the  platform’s  heading.  Each  time  the  operator 
clicks  on  the  forward  arrow  button  (lower-right  corner 
of  Eig.  2),  for  example,  the  platform’s  velocity  is  in¬ 
creased  one  increment.  Clicking  on  either  the  right- 
or  left-turn  arrows  imposes  a  differential  turn  on  the 
forward  velocity,  speeding  up  one  wheel  and  slowing 
down  the  other.  The  more  times  a  turn  arrow  is  clicked, 
the  bigger  the  differential  and  hence  the  faster  the  rate 
of  turn.  If  the  forward  (or  reverse)  speed  is  zero  (i.e., 
platform  stopped),  clicking  a  turn  button  causes  the 
robot  to  pivot  in  place. 

Once  the  platform  is  set  in  motion,  the  operator 
can  easily  control  its  subsequent  actions  by  clicking 
on  special  behavioral  icons  depicted  on  the  naviga¬ 
tion  display.  Eor  example,  selecting  a  wall-following 
icon  causes  the  platform  to  enter  wall-following  mode, 
maintaining  its  current  lateral  offset  from  the  indicated 
wall  using  side-looking  sonar.The  wall-followingicons 
are  implemented  as  long  vertical  command  buttons  sit¬ 
uated  on  either  side  of  the  Map  Window  in  the  lower 
left  corner.  The  nine  dots  displayed  in  front  of  the 
rectangular  robot  icon  at  the  bottom  of  the  map  in¬ 
dicate  the  measured  range  to  perceived  objects  in  the 
path. 

Two  additional  wall-segment  icons  are  seen  above 
the  map  in  the  form  of  short-length  horizontal  com¬ 
mand  buttons.  The  open  spaces  between  these  graphical 
depictions  of  wall  structures  represent  three  potential 
doorways:  one  directly  ahead  of  the  robot  and  one  on 
either  side.  By  clicking  in  one  of  these  doorway  icons, 
the  robot  is  instructed  to  seek  out  and  enter  the  next  en¬ 
countered  location  of  that  type  of  door  along  its  current 
path.  Eor  the  example  illustrated  Eig.  2,  the  platform 
is  looking  for  a  door  off  to  the  left,  as  indicated  by 
the  highlight  box  shown  in  the  selected  doorway  icon. 
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Ml.  Navigation  Ccmliol  Scieen 
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Figure  2.  Navigation  Control  Screen,  showing  the  high-level  driving  icons  surrounding  the  Map  Window  (lower  left  corner).  The  robot  has 
been  instructed  to  enter  the  next  door  encountered  on  the  left. 


and  the  associated  text  displayed  in  the  System  Status 
Window  above  the  map. 

The  primary  mobility  controls  shown  Fig.  2  are 
mimicked  on  a  stand-alone  hand-held  pendent  (Fig.  3) 
employing  an  array  of  capacitive  touch-sensor  icons, 
based  on  the  Quantum  Research  QProx  E6S2  matrix 
decoder.  A  high-resolution  2.5  -inch  color  LCD  monitor 
provides  video  output,  in  addition  to  selected  status  in¬ 
formation  overlaid  at  the  top  of  the  screen.  A  miniature 
motor-driven  eccentric  (as  found  in  vibrating  pagers) 
is  mounted  inside  the  enclosure  to  provide  tactile  mo¬ 
tion  feedback  to  the  user  (Everett  and  Nieusma,  1994). 
The  speed  of  this  motor  (and  hence  the  vibration  of  the 
case)  is  varied  in  direct  proportion  to  the  velocity  of 
the  remote  platform. 

2.2.  Camera  Control 

Manual  control  of  the  ROBART’Shead-mounted  cam¬ 
era  can  be  accomplished  using  the  slider  and  button 
controls  within  the  Head  Pan  Control  Window  on  the 


right  side  of  the  display  screen.  In  addition,  computer- 
aided  camera  pan  is  provided  to  support  the  three 
system  functionalities  of  platform  mobility,  intruder 
assessment,  and  weapon  tracking.  For  mobility,  the 
camera-pan  commands  are  embedded  within  the  “seek- 
door”  behaviors.  If  the  robot  is  instructed  to  enter  the 
next  door  on  the  right,  for  example,  the  camera  imme¬ 
diately  turns  45  degrees  right  of  center  to  acknowledge 
the  behavior  request  and  provide  a  better  view  of  the 
doorway  detection  process.  As  soon  as  the  door  is  de¬ 
tected  and  the  penetration  behavior  invoked,  the  cam¬ 
era  pans  to  compensate  for  the  platform’s  rate  of  turn 
in  order  to  keep  the  door  opening  in  the  center  of  its 
field-of-view. 

The  intruder  detection  and  assessment  algorithms 
operate  upon  the  output  from  the  video  motion  detec¬ 
tion  (VMD)  system  and  a  360-degree  array  of  passive- 
infrared  (PIR)  sensors  configured  as  a  collar)  ust  below 
the  head.  The  PIR  data  is  used  to  pan  the  surveil¬ 
lance  camera  to  the  center  of  any  zone  with  suspected 
intruder  activity.  The  VMD  output  is  then  used  to 
track  and  keep  the  intruder  in  the  center  of  the  visual 
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Figure  3.  A  capacitive  touch-panel  interface  on  the  hand-held  pendent  mimics  the  drive  icons  shown  in  Fig.  2. 


field,  using  a  combination  of  robot  head  and  body 
movement. 

Whenever  the  head  reaches  its  maximum  pan  limit 
(-h/-100  degrees)  relative  to  the  robot,  the  mobility  base 
will  pivot  in  place  towards  the  target.  The  head  mean¬ 
while  moves  at  the  same  speed  in  the  opposite  di¬ 
rection  to  keep  the  primary  target  in  the  center  of 
the  visual  field.  This  coordinated  action  provides  the 
robot  with  unlimited  (i.e.,  continuous  360-degree)  pan 
coverage. 

Automated  camera  pan  for  weapon  tracking  is  treat¬ 
ed  in  the  next  section. 

2.3.  Non-Lethal  Weapon  Control 

The  principle  non-lethal  response  system  incorpo¬ 
rated  on  ROBART  III  is  a  six-barreled  pneumatic  ally - 
powered  Gatling-gun  (Fig.  4)  capable  of  firing 
3/1 6-inch-diameter  simulated  tranquilizer  darts  or  plas¬ 
tic  bullets.  Projectiles  are  expelled  at  a  high  velocity 
from  12-inch  barrels  by  a  release  of  compressed  air 
from  apressurized  accumulator  at  the  rear  of  the  gun  as¬ 
sembly.  The  main  air  bottle  is  automatically  recharged 
by  a  small  12- volt  reciprocating  compressor  mounted 
in  the  robot’s  base. 

The  operator  specifies  what  type  of  control  strat¬ 
egy  (i.e.,  manual  or  automatic)  to  use  when  entering 
weapon-tracking  mode  by  clicking  on  the  appropriate 
option  in  the  Track  Mode  Window  (bottom-right  corner 


Figure4.  A  six-barrelpneumatic  tranquilizer  gun  is  used  to  demon¬ 
strate  computer-assisted  control  of  a  non-lethal  weapon. 


of  Fig.  5).  In  manual  mode,  the  firing  decision  is  made 
by  the  operator.  A  5-milliwatt  670-nanometer  visible- 
red  laser  sight  facilitates  manual  training  of  the  weapon 
using  video  from  the  head-mounted  surveillance  cam¬ 
era.  The  operator  can  slave  the  surveillance  camera  to 
the  weapon  pan  axis  by  clicking  on  the  “Head”  op¬ 
tion  in  the  Slave  Window  (just  below  the  System  Status 
Window,  wpptr  left  corner).  The  mobility  base  can  also 
be  slaved,  so  the  robot  turns  to  face  the  direction  the 
weapon  is  aimed.  If  a  forward  drive  speed  is  entered  at 
this  point,  the  operator  merely  has  to  keep  the  weapon 
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Figure  5.  Interim  control  and  diagnostic  screen  used  during  development  of  the  computer-assisted-weapon-control  software  on  ROBART  111. 


trained  on  the  intruder  for  the  robot  to  automatically 
give  chase. 

In  automatic  mode,  ROBART  111  is  responsible  for 
making  the  firing  decision,  contingent  upon  a  con¬ 
firmed  target  solution  stabilized  for  a  pre-determined 
time  interval,  and  pre-authorization  from  the  operator. 
Azimuthal  and  elevation  information  from  the  VMD  is 
available  to  the  right-shoulder  pan-and-tilt  controller 
for  purposes  of  automated  weapon  positioning.  When 
weapon-tracking  is  activated  in  automatic  mode,  the 
robot  centers  its  head  and  turns  to  face  toward  the  cur¬ 
rent  threat.  The  mobility  base  then  becomes  stationary 
while  the  weapon  begins  tracking  the  target. 

3.  Human-Centered  Mapping 

The  exploration  and  mapping  of  unknown  structures 
benefits  significantly  when  the  interpretation  of  raw 
sensor  data  is  augmented  by  simultaneous  supervi¬ 
sory  input  from  the  human  operator.  A  human-centered 
mapping  strategy  has  been  developed  to  ensure  valid 
first-time  interpretation  of  navigational  landmarks  as 
the  robot  builds  its  world  model  (currently  on  an  exter¬ 


nal  RF-linked  desktop  PC).  In  a  nutshell,  the  robot  can 
enter  and  explore  an  unknown  space,  building  a  valid 
model  representation  on  the  fly,  while  dynamically  re¬ 
referencing  itself  in  the  process  to  null  out  accumulated 
dead-reckoning  errors. 

Upon  first  entering  a  previously  unexplored  building, 
the  operator  guides  the  robot  using  typical  commands 
like;  “follow  the  wall  on  your  left,”  and  “enter  the 
next  doorway  on  the  left.”  Such  high-level  direction 
is  provided  by  clicking  on  screen  icons,  as  previously 
described.  In  addition  to  directing  the  robot’s  imme¬ 
diate  behavior,  however,  these  same  commands  also 
provide  valuable  information  to  the  world-modeling  al¬ 
gorithm.  The  ambiguity  of  interpreting  statistical  data 
for  the  purpose  of  classifying  certain  environmental  at¬ 
tributes  (i.e.,  walls  and  doorways,  in  this  example)  is 
completely  eliminated.  The  end  result  of  such  an  ap¬ 
proach  is  a  much  faster  and  more  accurate  generation  of 
object  representations  (relative  to  conventional  sensor- 
only  data  collections),  particularly  valuable  when  there 
is  no  a  priori  information  available  to  the  system. 

The  world  model  is  first  initialized  as  a  two- 
dimensional  dynamic  array  with  all  cells  marked  as 
unknown.  (An  unknown  cell  is  treated  as  potentially 
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traversable,  but  more  likely  to  be  occupied  than  con- 
firmed/ree  space.)  If  some  specific  subset  of  the  cur¬ 
rent  sonar  data  can  be  positively  identified  from  the 
outset  as  a  wall-like  structure,  it  can  be  unambiguously 
modeled  as  a  confirmed  wall  without  the  need  for  sta¬ 
tistical  representation.  This  makes  the  resulting  world 
representation  much  less  ambiguous  and  therefore  less 
subject  to  error. 

In  support  of  this  objective,  ROBART  111  has  been 
equipped  specifically  to  support  supervised  operation 
in  previously  unexplored  interior  structures.  Two  self- 
contained  Electro  Corporation  piezoelectric  PCUC- 
series  ultrasonic  sensors  operating  at  2 15  KHz  are  used 
to  generate  range  data  for  the  wall-following  algorithm. 
These  sonar  sensors  operate  at  a  much  higher  frequency 
than  the  49.4-KHz  Polaroid  sensors  used  for  collision 
avoidance,  so  there  are  no  problems  associated  with 
crosstalk  from  simultaneous  operation  of  both  types. 
In  addition,  the  higher  frequencies  support  better  accu¬ 
racy  with  a  maximum  effective  range  of  about  6  feet, 
which  is  ideal  for  wall  following.  (The  shorter  effec¬ 
tive  range  limit  allows  the  left  and  right  sonar  sensors 
to  asynchronously  operate  without  mutual  interference, 
for  a  faster  update  rate). 

4.  Orthogonal  Navigation 

The  Achilles  Heel  of  any  world-modeling  scheme, 
however,  is  accurate  positional  referencing  in  real-time 
by  the  moving  platform.  Since  all  sensor  data  is  taken 
relative  to  the  robot's  location  and  orientation,  the  accu¬ 
racy  (and  usefulness)  of  the  model  quickly  degrades  as 
the  robot  becomes  disoriented.  While  wall  following  is 
a  very  powerful  tool  in  and  of  itself  for  determining  the 
relative  offset  and  heading  of  the  robot,  conventional 
schemes  normally  assume  some  a  priori  information 
about  the  wall  in  the  first  place  to  facilitate  its  utility 
as  a  navigational  reference.  In  short,  a  relative  fix  with 
respect  to  an  unknown  entity  does  not  yield  an  unam¬ 
biguous  absolute  solution,  for  obvious  reasons. 

ROBART  111  uses  a  world  modeling  technique  that 
requires  no  such  a  priori  information.  This  navigation 
scheme,  called  orf/iogona/  navigation,  or  "Ortho-Nav, " 
exploits  the  orthogonal  nature  of  most  building  struc¬ 
tures  where  walls  are  parallel  and  connecting  hallways 
and  doors  are  orthogonal.  Ortho-Nav  also  uses  the  in¬ 
put  from  a  magnetic  compass  to  address  the  issue  of 
absolute  wall  orientation.  The  accuracy  of  the  compass 
need  be  only  good  enough  to  resolve  the  ambiguity  of 


which  of  four  possible  wall  orientations  the  robot  has 
encountered.  This  information  is  stored  in  the  model 
in  conjunction  with  the  wall  representation  (i.e.,  wall 
segment  running  north-south,  or  wall  segment  running 
east-west),  in  arbitrary  building  coordinates.  The  pre¬ 
cise  heading  of  the  vehicle  (in  building  coordinates) 
is  then  mathematically  derived  using  sonar  data  taken 
from  the  wall  surface  as  the  robot  moves. 

A  typical  wall-following  routine  uses  a  ranging 
sensor  to  maintain  a  particular  distance  from  a  pla¬ 
nar  object  (wall)  on  one  or  both  sides.  Due  to  sensor 
inaccuracies  and  the  accumulation  of  errors  inherent 
in  odometry,  the  range  data  will  appear  to  drift  toward 
or  away  from  the  robot,  resulting  in  a  wall  plot  that  is 
skewed  or  perhaps  even  curved.  These  errors  can  be 
mitigated  by  assuming  that  the  wall  is  straight  and  im¬ 
movable,  and  any  perceived  undulations  in  the  sonar 
data  plot  in  actuality  represent  irregular  motion  of  the 
robot.  Armed  with  this  heuristic,  both  the  lateral  offset 
and  heading  of  the  robot  can  be  dynamically  corrected, 
even  while  the  world  model  is  still  being  generated. 

In  order  for  this  system  to  work  properly,  the  robot 
must  follow  a  reasonably  planar  wall  surface  rather 
than  just  blindly  reacting  to  whatever  clutter  is  nearby. 
This  is  where  the  human-centered  aspect  of  the  scheme 
comes  into  play.  By  way  of  example,  when  the  robot 
enters  an  unknown  space  under  telereflexive  control 
as  illustrated  in  Fig.  6,  the  operator  examines  the  video 
and  informs  the  robot  there  is  a  wall  it  can  follow  on  the 
left  side.  In  addition,  the  operator  also  clicks  on  the  left 
doorway  icon  (as  illustrated  earlier  in  Fig.  2)  to  further 
instruct  the  robot  to  find  and  enter  the  next  doorway  on 
the  left.  The  onboard  computer  then  begins  acquiring 
range  data  from  the  appropriate  sensors.  When  enough 
points  have  been  accumulated  for  a  fit  (subject  to  a 
quality-of-fit-criteria),  the  resulting  line  is  examined  to 
determine  its  orientation. 

The  majority  of  buildings  are  laid  out  such  that  all 
walls  are  either  parallel  or  orthogonal  to  one  another, 
so  the  orientation  of  the  line  i  s  snapped  to  0,  90° ,  1 80° , 
or  270°  in  arbitrary  building  coordinates.  The  robot's 
heading  is  then  reset  to  this  same  value.  Once  the  initial 
location  of  the  wall  has  been  established,  an  infinitely 
long  potential-wall  representation  is  entered  into  the 
model  (Fig.  7). 

As  the  robot  continues  to  follow  the  actual  wall  get¬ 
ting  valid  line  fits,  it  incrementally  converts  the  poten¬ 
tial  wall  to  a  confirmed  wall. 

As  previously  discussed,  the  robot  can  now  correct 
its  lateral  position  by  using  the  wall  as  a  reference.  For 
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Figure  6.  Initial  view  of  an  interior  space  as  seen  from  the  robot’s  onboard  surveillance  camera,  revealing  a  clean  wall  for  following  on  the 
immediate  left. 


Figure  7.  After  obtaining  the  first  wall  fit,  apotential  wall  is  created 
and  indexed  to  the  cardinal  heading  which  most  closely  matches  the 
magnetic  compass  reading. 


the  situation  shown  above,  given  that  the  X  coordinate 
of  the  wall  is  Wx  and  the  current  range  to  the  wall  is 
r,  the  robot’s  X  coordinate  is  given  by  Rx  =  Wx  +  r. 
Similarly,  the  robot’s  current  heading  can  be  dynami¬ 
cally  corrected  by  subtracting  the  difference  between 
the  orientation  of  the  current  wall  fit  and  the  current 
wall  orientation  from  the  robot’s  current  heading.  This 


is  given  by  the  following  equation; 

Re  =  R9-  (Fe  -  W9) 

where; 

Rg  =  the  robot’s  current  heading 

Fg  =  the  orientation  of  the  current  wall  fit 

Wg  =  the  orientation  of  the  current  wall 

The  robot  turns  left  (as  previously  instructed)  to 
enter  the  discovered  doorway,  using  the  ranging  sen¬ 
sors  on  both  sides  to  determine  the  size  of  the  open¬ 
ing  that  must  be  cut  in  the  wall  it  has  been  construct¬ 
ing  (Fig.  S),to  form  the  (ioorvray  representation.  After 
transitting  the  doorway,  the  robot  next  detects  and  be¬ 
gins  to  follow  a  wall  to  its  right.  Accordingly,  it  con¬ 
structs  a  new  potential  wall  and  snaps  it  perpendicular 
to  the  previous  model  entry.  Note  this  second  poten¬ 
tial  wall  (shown  horizontally)  is  semi-infinite,  in  that  it 
is  clipped  against  the  previously  constxucitd potential 
wall  (shown  vertically). 

Whenever  the  robot  detects  a  new  potential  wall,  it 
compares  it  to  the  list  of  potential  and  confirmed  walls 
already  constructed.  If  the  new  wall  coincides  (within 
pre-specified  orientation  and  offset  tolerances)  with  a 
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Confirmed  Wall 


Potential  Wall 


Figure  8.  As  the  robot  enters  the  found  doorway,  the  modeling  algo¬ 
rithm  uses  the  side-sonar  range  information  to  cut  an  appropriately- 
sized  opening  through  the  existing  (shown  vertical)  confirmed-  and 
potential-wall  representations.  The  new  {fvox\zoni?i\) potential  wall 
is  clipped  against  the  previously  connixwciQd potential  wall. 


previously  modeled  wall,  the  range  data  is  snapped 
to  the  existing  representation,  rather  than  generating 
a  new  one. 


5.  Experimental  Results 

ROB  ART  in  has  been  operational  in  reflexive  teleop¬ 
eration  mode  since  1997,  supporting  extensive  testing 
and  evaluation  of  the  high-level  drive  control  interface 
by  a  variety  of  skilled  and  unskilled  users.  The  result¬ 
ing  feedback  has  significantly  influenced  subsequent 
upgrades  to  both  hardware  (i.e.,  the  type  and  placement 
of  collision  avoidance  sensors)  and  software  (i.e.,  the 
layout  and  functionality  of  icons  in  the  drive  control 
window). 

The  consensus  of  all  parties  involved  was  very  posi¬ 
tive  with  respect  to  the  effectiveness  of  the  user-friendly 
interface,  which  allowed  even  first-time  operators  to 
achieve  within  minutes  a  degree  of  proficiency  that 
would  otherwise  take  weeks  or  even  months  to  real¬ 
ize.  A  very  common  observation  was  the  significantly 


reduced  reliance  on  video  feedback,  which  allowed 
safe  transit  to  continue  during  periods  of  severe  video 
breakup  from  multipath  reflection  or  RF  signal  occlu¬ 
sion. 

The  stand-alone  capacitive  touch  panel  (Fig.  3)  met 
with  mixed  reviews;  the  tactile  velocity  feedback  was 
felt  to  be  a  very  useful  feature,  but  the  input  scheme 
was  subject  to  spurious  activation  through  careless 
handling,  especially  in  the  dark  when  the  icons  were 
not  easily  discernable.  A  voice-activated  (i.e.,  speech 
recognition)  input  scheme  has  been  briefly  tested  as  an 
alternative  approach . 

In  addition,  the  line-oriented  video  motion  detection 
hardware,  initially  developed  in  1988  for  ROB  ART  H 
(Everett  et  ak,  1990)  proved  to  be  fairly  inadequate 
in  very  dynamic  intruder  tracking  scenarios,  due  to 
the  limited  resolution  and  update  rate.  Current  efforts 
are  investigating  an  upgrade  to  the  stereoscopic  Small 
Vision  Module  developed  by  SRI  (Konolidge,  1997). 

More  recent  testing  (i.e.,  within  the  last  two  years) 
has  addressed  the  effectiveness  of  the  human-centered 
mapping  scheme.  The  most  noticeable  improvement 
early  on  was  availability  of  the  real-time  snapshot  sonar 
plots  (Fig.  2)  to  augment  forward-area  perception  by 
the  operator  during  video  dropouts.  With  a  little  prac¬ 
tice,  experienced  operators  were  able  to  execute  simple 
missions  (i.e.,  traverse  hallway  and  enter  third  doorway 
on  right,  for  example)  with  no  video  feedback  at  all.  As 
the  human-centered  mapping  algorithms  evolved,  the 
resultant  map  display  became  even  more  useful  from 
the  standpoint  of  an  accumulated  geometric  represen¬ 
tation  of  the  operating  environment.  Minor  registra¬ 
tion  problems  were  still  observed  when  circuitously 
revisiting  a  region  previously  mapped,  due  to  accumu¬ 
lated  dead  reckoning  errors,  even  with  the  dynamic  re¬ 
referencing  features  employed.  This  deficiency  is  being 
addressed  through  the  addition  of  a  KVH  fiber-optic 
rate  gyro  to  minimize  uncertainty  growth  in  vehicle 
heading  (Chung  et  ak,  2000). 


6.  Conclusion 

Much  note  worthy  progress  has  recently  been  made  with 
regard  to  navigating  without  a  priori  map  informa¬ 
tion,  particularly  under  the  DARPA  Tactical  Mobile 
Robot  program  (Krotkov  and  Blitch,  1999). But  forthe 
most  part,  little  has  been  done  to  simplify  the  coordi¬ 
nated  control  of  platform  motion  and  any  associated 
application  payload  from  the  operator’s  perspective. 
This  paper  covers  the  implementation  of  a  prototype 
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tactical/security  response  robot  capable  of  supervised- 
autonomous  exploration  in  unknown  structures.  The 
system  is  able  to  confront  intruders  with  a  laser-sighted 
tranquilizer  dart  gun,  and  automatically  track  a  mov¬ 
ing  target  with  the  use  of  various  sensors.  A  human- 
centered  mapping  scheme  ensures  more  accurate  first¬ 
time  interpretation  of  navigational  landmarks  as  the 
robot  builds  its  world  model,  while  orthogonal  navi¬ 
gation  exploits  the  fact  that  the  majority  of  man-made 
structures  are  characterized  by  parallel  and  orthogonal 
walls. 
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